Appl. No: 09/777,139 

Amdt. Dated May 24, 2005 

Reply to Office action of February 24, 2005 

A, Amendments to the Claims: 

This listing of claims will replace all prior versions and listings of claims in 

the application: 
Listing of Claims: 

1 . (Currently Amended) A data storage system comprising: 
a plurality of storage nodes; 

data storage mechanisms implemented in each storage node; 

a communication medium linking storage nodes; and 

a quant i ty of data distributed across a selected set of the storage nodes 

such that the qu a nt i ty of data remains available irrespective of the unavailability 

of one or more of the storage nodes within the selected set. 

2. (original) The data storage system of claim 1 wherein the data 
storage mechanisms on at least two storage nodes collectively implement a 
unitary volume of network storage, 

3. (original) The data storage system of claim 1 wherein the 
communication medium comprises: 

a public network for receiving access requests for the data storage 
system; and 

a private network enabling communication between storage nodes. 

4. (original) The data storage system of claim 3 wherein the public 
network comprises the Internet. 

5. (original) The data storage system of claim 3 wherein the private 
network comprises a virtual private network implemented over the Internet. 

6. (original) The data storage system of claim 1 further comprising: 
communication processes implemented within each of the storage nodes 

operable to exchange state information between at least some of the other data 
storage nodes. 
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7. (original) The data storage system of claim 1 wherein each of the 
data storage nodes further comprises data structures configured to store state 
information about one or more other nodes and the communication links 
between them. 

8. (original) The data storage system of claim 7 wherein the state 
information comprises information selected from the group consisting of but not 
limited to: availability information, capacity information, quality of service 
information, performance information, geographical location information, network 
topological location information. 

9. (original) The data storage system of claim 8 wherein the set of 
storage nodes is selected by a first of the storage nodes using the state 
information stored in the first of the storage nodes. 

10. (Currently Amended) [[The]] A data storage system of c l aim 7 
comprising: 

a plurality of storage nodes wherein each of the data storage nodes 
further comprises data structures configured to store state information about one 
or more other nodes and the communication links between them: 

data storage mechanisms implemented in each storage node: 

a communication medium linking storage nodes: 

communication processes implemented within each of the storage nodes 
operable to exchange state information between at least some of the other data 
storage nodes: 

data distributed across a selected set of the storage nodes such that the 
data remains available irrespective of the unavailability of one or more of the 
storage nodes within the selected set: and 

wherein the communication processes implement a repetitive peer-to- 
peer conversation between the set of storage nodes enabling the state 
information contained in the state information data structures within each 
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individual node to represent a consistent view of the state of the collection of 
storage nodes. 

1 1 . (original) The data storage system of claim 1 wherein the network 
comprises: 

a plurality of first level networks, each first level network coupling multiple 
storage nodes; and 

a second level network coupling at least two of the first level networks. 

12. (original) The data storage system of claim 1 1 wherein the first 
level network comprises a connection selected from the group consisting of: 
Ethernet, fast Ethernet, gigabit Ethernet, Fibre channel, ATM, firewire, Myernet, 
SCSI, serial, parallel, universal serial bus, and wireless networks. 

13. (original) The data storage system of claim 1 further comprising: 
storage management processes executing on one of the storage nodes to 

determine state information about each of the set of storage nodes. 

14. (original) The data storage system of claim 1 wherein the 
communication medium comprises a secure communication medium. 

15. (original) The data storage system of claim 1 wherein the 
communication medium implements an authentication protocol between linked 
storage nodes. 

16. (original) The data storage system of claim 1 wherein the 
communication medium implements cryptographic security between linked 
storage nodes. 

17. (original) A method of managing data storage in a network 
comprising multiple storage nodes, the method comprising the acts of: 

communicating a storage request to at least one storage node; and 
causing the at least one storage node to implement the storage request 
using an arbitrary subset of the storage nodes. 
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18. (original) The method of claim 17 further comprising: 
communicating state information between the multiple storage nodes; and 
selecting the arbitrary subset of the multiple storage nodes to be used 

based upon the state information. 

19. (original) The method of claim 17 wherein the act of implementing 
the storage request comprises associating error checking and correcting (ECC) 
code with storage request. 

20. (original) The method of claim 19 wherein the ECC code is stored 
in a single network storage node and the unit of data is stored in two or more 
network storage nodes. 

21 . (original) The method of claim 1 7 further comprising: 
retrieving a stored unit of data specified by the storage request; and 
verifying the correctness of the stored unit of data; 

upon detection of an error in the retrieved unit of data, retrieving the 
correct unit of data using data stored in the others of the arbitrary subset of the 
multiple storage nodes. 

22. (Currently Amended) [The] A method of managing data storage in 
a network comprising multiple storage nodes, the method c l a i m 17 furth e r 
comprising: 

communicating a storage reguest to at least one storage node; 

causing the at least one storage node to implement the storage reguest 
using an arbitrary subset of the storage nodes; 

attempting to retrieve the stored unit of data from the arbitrary subset of 
the multiple storage nodes; 

detecting unavailability of one or more network storage nodes; and 

in response to detected unavailability, retrieving the correct unit of data 
using data stored in others of the arbitrary subset of the multiple storage nodes. 
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23. (original) The method of claim 22 wherein the unavailability is 
caused by failure of one or more of the network storage nodes. 

24. (original) The method of claim 22 wherein the unavailability is 
caused by congestion/failure of a network link leading to one or more of the 
network storage nodes. 

25. (original) The method of claim 17 further comprising moving the 
stored unit of data from one network storage node to another network storage 
node after the step of storing. 

26. (original) The method of claim 17 further comprising: 
communicating state information and storage requests amongst the 

arbitrary subset of the storage nodes; and 

encrypting at least some of the information and storage requests before 
communicating them between storage nodes. 

27. (original) The method of claim 17 further comprising: 
communicating state information and storage requests amongst the 

arbitrary subset of the storage nodes; and 

authenticating the communication between storage nodes. 

28. (original) A data storage system comprising: 

a peer-to-peer network of storage devices, each storage device having 
means for communicating state information with other storage devices, at least 
one storage device comprising means for receiving storage requests from 
external entities, and at least one storage device comprising means for causing 
read and write operations to be performed on others of the storage devices. 

29. (original) The system of claim 28 wherein each of the storage 
devices comprises means for causing read and write operations to be performed 
on others of the storage devices. 
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30. (original) The system of claim 28 wherein each of the storage 
devices comprises data structures defined to configure at least two 
geographically distant ones of the data storage devices as a unitary volume of 
storage. 

31 . (original) The system of claim 30 further comprising: 
a network coupling to each of the data storage devices; and 

a storage controller coupled to the network for logically combining the at 
least two data storage devices into a single logical storage device. 

32. (Currently Amended) A distributed data storage array comprising: 
a plurality of network connected storage nodes; 

a network interface within each storage node for receiving data and 
control information from other storage nodes; 

a network interface within at least one storage node for receiving data 
storage access requests from external sources; and 

storage management processes within the at least one storage node 
operable to distribute data storage for [[a]] logically contiguous quant i ty of data 
across multiple storage nodes. 

33. (original) A data storage system implemented on top of a plurality 
of networked computer systems and a communication network, wherein each of 
the networked computer systems implements a storage node and comprises: 

a processor for processing data according to program instructions; 

a network interface coupled to the processor and the network for 
communicating data with external entities, including other storage nodes, across 
the network; 

memory coupled to the processor, the memory comprising storage space 
configured to store data and instructions used by the processor; 

one or more mass storage devices coupled to the processor; 

a communication process comprising program instructions executing in 
the storage node and in communication with the network interface to provide an 
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interface to communicate data storage access requests and responses with the 
external entities; 

storage management processes comprising program instructions 
executing in the storage node and responsive to the received data storage 
access requests and in communication with the network interface to distribute 
and coordinate data storage operations with external storage nodes. 

34. (original) The system of claim 33 wherein the storage 
management processes include processes that communicate with the external 
storage nodes to provide fault-tolerant distribution of data across the a plurality 
of storage nodes, 

35. (original) The system of claim 33 wherein the storage 
management processes include processes for distributing data redundantly to 
protect against faults that make one or more storage nodes unavailable. 

36. (original) The system of claim 33 wherein the storage 
management processes includes fault recovery processes, wherein the fault 
recovery processes respond to a fault condition by communicating with at least 
one of the external storage nodes to make available a set of data that would 
otherwise be unavailable as a result of the fault condition. 
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